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Abstract 



. This paper studies a cooperative cognitive radio network where two primary users (PUs) exchange 

(N 



information with the help of a secondary user (SU) that is equipped with multiple antennas and in return, 
the SU superimposes its own messages along with the primary transmission. The fundamental problem 
in the considered network is the design of transmission strategies at the secondary node. It involves 
three basic elements: first, how to split the power for relaying the primary signals and for transmitting 
the secondary signals; second, what two-way relay strategy should be used to assist the bidirectional 
communication between the two PUs; third, how to jointly design the primary and secondary transmit 
precoders. This work aims to address this problem by proposing a transmission framework of maximizing 
the achievable rate of the SU while maintaining the rate requirements of the two PUs. Three well-known 
and practical two-way relay strategies are considered: amplify-and-forward (AF), bit level XOR based 
decode-and-forward (DF-XOR) and symbol level superposition coding based DF (DF-SUP). For each 



> 

(N 

relay strategy, although the design problem is non-convex, we find the optimal solution by using certain 



transformation techniques and optimization tools such as semidefinite programming (SDP) and second- 
order cone programming (SOCP). Closed-form solutions are also obtained under certain conditions. 
Simulation results show that when the rate requirements of the two PUs are symmetric, by using the 
DF-XOR strategy and applying the proposed optimal precoding, the SU requires the least power for 
relaying and thus reserves the most power to transmit its own signal. In the asymmetric scenario, on the 
other hand, the DF-SUP strategy with the corresponding optimal precoding is the best. 
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Cognitive radio, two-way relaying, multiple-input multiple-output (MIMO), precoding, convex opti- 
mization. 

I. Introduction 

Due to the increasing popularity of wireless devices, the radio spectrum has been an extremely scarce 
resource. By contrast, most of the existing licensed spectrum remains under-utilized. Cognitive radio 
(CR) is an efficient way to improve spectrum utilization (TJ, Q. The basic idea of CR is to allow 
unlicensed or secondary users (SUs) to access the licensed spectrum originally allocated to primary users 
(PUs) without sacrificing the quality-of-service (QoS) of the PUs. Some fundamental problems, such as 
reliable spectrum sensing [3] and dynamical spectrum access (see |H and the reference therein), have 
been well studied. Recently, combining CR with cooperative or relay techniques has received a great 
deal of interest from both academia and industry since it can make CR more reliable in application Q- 
If8ll . It is worth noting that most of these existing works focus on unidirectional communications using 
traditional one-way relay strategies. 

Due to bidirectional or two-way nature of communication networks, a promising relay technique, 
two-way relaying, has been proposed recently. Two-way relaying applies the principle of physical layer 
network coding (PLNC) at the relay node so as to mix the signals received from the two source nodes, 
and then employs self-interference (SI) cancelation at each destination to extract the desired information 
|[9l- |[T3l . As a result, two-way relaying needs less time slots to complete information exchange between 
two sources and has higher spectral efficiency than the traditional one-way relaying. It is thus natural to 
incorporate two-way relaying into CR networks to further enhance the spectrum utilization. One possible 
scenario is to apply dedicated relay nodes to assist the bidirectional communication of secondary networks 
as in lPT4l . lfl31 . In specific, authors in fffl considered the two-way relaying between a pair of SUs 
with a dedicated multi-antenna amplify-and-forward (AF) relay node, and studied the problem of joint 
beamforming and power allocation with interference constraint at the PU. Authors in lfl31 considered 
a similar network model but with multiple dedicated single-antenna AF relays, and investigated the 
distributed beamforming design at the secondary network to minimize interference at the PUs with the 
SUs' signal-to-interference-plus-noise ratio (SINR) constraints. 

In this work, we consider a different transmission protocol where users in the primary network conduct 
bidirectional communication with the help of a multi-antenna secondary node, rather than dedicated relay 
nodes. Specifically, the multi-antenna secondary node acts as a relay to help the information exchange 
between two PUs, and as a return, the secondary node is allowed to simultaneously send its own messages 
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in the same frequency band to the secondary receiver. The considered protocol can be viewed as an overlay 
model [2], which creates a "win-win" situation for both PUs and SUs. Under this setting, two primary 
signals should be first combined together via physical layer network coding at the secondary node, and 
then superimposed with the secondary signal. Three issues should be carefully treated in the design 
of transmission strategies at the secondary node, including 1) how to split the power for relaying the 
primary signals and for transmitting the secondary signals; 2) what two-way relay strategy should be 
used to assist the bidirectional communication between the two PUs; and 3) how to jointly design the 
primary and secondary transmit precoders. 

Note that using two-way relaying to assist primary transmission has also been considered in works 
[16), ifTTl . Specifically, authors in |[T6l studied the beamforming design at the secondary transmitters for 
minimizing the total system power while guaranteeing the SINR requirements of all receivers. However, 
in |[T6l . the secondary transmitters exclusively act as AF relays when the PU pair is active or transmit 
their own signals only when the PU pair is inactive. Authors in IfTTl considered a similar overlay protocol 
as ours. However, it focused on outage performance analysis for a three-phase single-antenna CR network 
with bit level XOR based decode-and-forward (DF-XOR) relay strategy. 

In this paper, we consider a two-phase overlay cognitive two-way relay network. In the first phase, two 
PUs transmit their signals to a multi-antenna secondary node simultaneously. In the second phase, after 
combining the two primary signals using physical layer network coding, the secondary node superimposes 
its own message and then broadcasts the resulting signal to the two primary receivers as well as its own 
secondary receiver. We aim to address the aforementioned three issues, namely, relay strategy selection, 
power splitting and joint precoding design by proposing a transmission framework of maximizing the 
achievable rate of the SU while maintaining the rate requirements of the two PUs. To achieve this goal, 
we first identify three popular and practical two-way relay strategies: AF, DF-XOR and symbol level 
superposition coding based DF (DF-SUP). Then, for each relay strategy we find the optimal power 
splitting and joint precoding design at the secondary node. It is shown that each design problem is non- 
convex. By transforming these problems into more tractable forms, some efficient optimization tools, 
such as semidefinite programming (SDP) and second-order cone programming (SOCP), are applied to 
find the optimal solutions of all the schemes. Moreover, we derive the optimal closed-form solutions in 
several cases where some of the channels are parallel in the second phase. Simulation results show that 
when the rate requirements of the two PUs are symmetric, by using the DF-XOR strategy and applying 
the proposed optimal precoding, the SU requires the least power for relaying and thus reserves the most 
power to transmit its own signal. However, when the rate requirements of the two PUs are asymmetric, 
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the DF-SUP relay strategy with the corresponding optimal precoding is the best and requires the least 
relay power consumption in satisfying the rate requirements of the PUs. 

The rest of this paper is organized as follows. In Section II, the cognitive two-way relay system model 
is described. Solving associated optimization problems by using suitable optimization tools is presented in 
Section III. Extensive simulation results are illustrated in Section IV. Finally, Section VI offers concluding 
remarks. 

Notations: £(■) denotes the expectation over the random variables within the bracket. ® denotes 
the Kronecker operator. Superscripts (•)* and (-) H denote the transpose, conjugate and conjugate 
transpose, respectively. Tr(A), A -1 det(A) and Rank(A) stand for the trace, inverse, determinant and 
the rank of matrix A, respectively. Diag(a) denotes a diagonal matrix with a being its diagonal entries. 
OjvxM implies the N x M zero matrix and I/y denotes the N x N identity matrix. \z\ implies the norm 
of the complex number z, 3t(z) and $s(z) denote the real and imaginary part of z, respectively. ||x||2 
denotes the squared Euclidean norm of a complex vector x and ||X|||. denotes the Frobenius norm of a 
complex matrix X. The distribution of a circular symmetric complex Gaussian vector with mean vector 
x and covariance matrix S is denoted by CA/"(x, XI). C xxy denotes the space of x x y matrices with 
complex entries. 

II. System Model 

Consider a primary network, where two PUs, denoted as A and B, intend to exchange information in 
a licensed frequency band as shown in Fig. Q] Due to impairments such as multipath fading, shadowing, 
path loss of wireless channels and obstacles etc., the direct communication channel between A and B 
is assumed not strong enough to support a target data rate for information exchange. They thus seek 
cooperation with a nearby node C from the secondary network. That is to say, the secondary node C 
acts as a relay to assist the bidirectional communication between A and B. As a return, the secondary 
node C is allowed to superimpose its own message into the relayed primary signals and then broadcasts 
the resulting signal to the two primary receivers as well as its own secondary receiver D. 

Due to the absence of direct link, we assume that two-phase two-way relaying protocol is employed 
to complete the bidirectional communication. Specifically, in the first phase (also referred as multiple 
access (MAC) phase), both A and B transmit their signals to the secondary node C simultaneously. By 
assuming that M antennas are equipped at C, the received signal vector at C is denoted as 

y c = h A s A + h B s B + nc, 
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where Sj, for i E {^4, B}, represents the transmit signal from the PU i. hj G C is the channel vector 
from the PU i to the secondary node C, and nc denotes the additive complex Gaussian noise vector at 
C following CA/"(0, o^Im)- Each transmit signal Sj is assumed to satisfy an average power constraint, 
i.e., £(|sj| 2 ) = Pj. In the meantime, the secondary receiver D, equipped with single antenna, can also 
overhear the signals from the PUs A and B, and the received signal is given by 

VD,1 = hADSA + h B DSB + n D> i, 

where Had and Hbd denote the channel gains from the PUs A and B, respectively, to the secondary 
receiver D, and no,i denotes the additive complex Gaussian noise at D following CJ\f(0,ajj). The 
secondary receiver D can decode the received signals in the first phase, which can be treated as side 
information for improving the performance of the secondary transmission in the second phase. 

Upon receiving yc the secondary node C performs certain processing and then forwards it together 
with its own message in the second phase, also referred as broadcast (BC) phase. Let the transmit signal 
from C be denoted as 

XC = X AB + S, (1) 

where xab is the combined signal of the two primary messages by using PLNC and s denotes the signal 
intended to the secondary receiver D. As mentioned earlier, the fundamental problem here is to design 
the structures of ^ab and s, and the power splitting between them. 

By adopting different two-way relay strategies, the transmit signal ~&ab can be different. In the case 
of pure two-way relaying (i.e., s = 0), the optimal design of x^b is essentially equivalent to designing 
a coding strategy to achieve multiple single-link capacities in BC phase by transmitting one encoded 
signal as in ||T~8Tl — [20 1. Intuitively, the optimal relay strategy in our considered network should be also 
designed like this. However, in this work we only focus on using some sub-optimal relay strategies since 
the capacity-achieving two-way relay strategies proposed in fi"8l - ll20ll are derived from the information 
theoretic perspective and hence require techniques such as random binning and jointly typical set decoding 
which are difficult to realize in practice. The primary focus of this work is to obtain the optimal and 
specific linear precoding structure based on practical two-way relay strategies. The three sub-optimal 
strategies we considered, namely, AF, DF-XOR and DF-SUP, are all favorable for practical implementation 
and the precoding designs based on these strategies are mathematically tractable. 
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A. AF Relay Strategy 

By applying AF relay strategy, the signal ~x-ab for the PUs in £T|) can be expressed as 

*AB = Wye = Wh A s A + Wh B s B + Wn c , 

where W represents the precoding matrix for the primary signals. In addition, we assume that the 
secondary node C has the maximum transmit power Pc, which yields 

£(^c) = PA\\Wh A \\l + P B \\Wh B \\ 2 2 + Tr(Q s ) + a 2 c \\W\\ 2 F < P C , (2) 

where Q s = £(ss H ) is the covariance matrix of s. Then the received signals at A and B are given by 

Vi = gf Wh-s- + gfWhiSi + gfs + gf Wn c + rn, i = A,B (3) 

where i = B if i = A and i = A if i = B, gj denotes the channel vector from the secondary node C 
to the destination node i, and m denotes the additive Gaussian noise at the destination node i following 
CN(0, of) for i G {A, B}. The received signal at the secondary receiver D in the second phase is given 
by 

VD,2 = gDWh A SA + goWh B s B + go s + gS Wn c + n D ,2, (4) 

where go represents the channel vector from the secondary node C to the secondary receiver D, and 
n B: 2 denotes the additive Gaussian noise at D in the second phase following CM(0, <? 2 D )- Since the 
PUs A and B know their own transmit messages sa and sg a prior, respectively, the back propagated 
self-interference term Sj can be subtracted from (f3]) before demodulation. The equivalent received signals 
at A and B are thereby yielded as 

Vi = gf Wh-s; + gf s + gf Wn c + fk, i = A,B. (5) 

Similarly, if the secondary receiver D can decode sa or/and s B , the corresponding interference can be 
subtracted from (O, which is helpful for improving the performance of the secondary transmission. The 
details shall be discussed in the next section. 

B. DF-XOR Relay Strategy 

If the secondary node C adopts DF relay strategy, namely DF-XOR and DF-SUP O, 11211 . it needs 
to decode the received signals in the first phase, which is known as a MAC channel. We assume that the 
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secondary node C has enough processing ability to correctly decode the received signals if the transmit 
rates from the two PUs lie in the rate region given as follows 

R A < log 2 ( 1 + 



i? B <log 2 (l + ^") (6) 



Cmac(Ra, Rb) = < 

Ra + Rb< log 2 det (l M + ^fh A h% + ||h s hg ) 
where Ra and Rb are the transmit rates of the PUs A and B, respectively. If any of sa and sb has not 
been correctly decoded, we claim that the primary transmission is in outage. 

Let hi denote the decoded bit sequence from Sj, for i £ {A, B}. By applying XOR operation, the 
combined bit sequence is yielded as b^B = b A © bai where © denotes the XOR operator. Then the 
combined bit sequence b A B is encoded and modulated as an M x 1 signal sab- Thus we have x.ab = &AB- 
To satisfy the power constraint at C, we have 

£(x c x£) = Tt(Qab) + Tr(Q s ) < P c , (7) 

where Qab = £(^ab^ab) ^ s tne co variance matrix of sab- The received signal at each primary 
destination is given by 

Vi = gfsAB + gfs + rii, i = A,B. (8) 

Each PU i can demodulate the received signal yi and then XOR it with its own transmit bits to obtain 
the desired information. Similarly, the received signal at the secondary receiver D is given by 

VD,2 = g^SAB + g^s + n D>2 - (9) 

If D correctly decodes both sa and sb in the first phase, the interference term g^s ab can be subtracted 
from ©. 

C. DF-SUP Relay Strategy 

If the secondary node C adopts the DF-SUP relay strategy, we have x^b = + s#, where Sj, for 
i G {A, B}, represents the re-encoded and modulated signal of the PU i. The power constraint at C is 
then denoted as 

£(x c x£) = Tr(Q A ) + TV(Q B ) + Tr(Q s ) < P c , (10) 



'if the lengths of the bit sequences b,4 and b_g are different, zero-padding is exploited to the shorter one to make it have the 
same length as the longer one. 



s 



where Qj = £(sisf), for i G {^4, B}, is the covariance matrix of Sj. After self-interference cancelation, 
the received signal at each primary destination is yielded as 

Vi = gfs- + gf s + n^, i = A,B. (11) 

The received signal at the secondary receiver D is denoted as 

VD,2 = Sd( s a + sb) + g£>s + n D)2 . (12) 

Here, any correctly decoded message in the first phase can be applied to subtract the corresponding 
interference in (fl2l) as in the AF case. 

Before leaving this section, we provide some discussions on the cooperation between the PUs and 
the SU in the considered cognitive two-way relay network. In this work, we assume that all the designs 
are performed at the secondary node C and thus following network channel state information (CSI) are 
needed at C. The channel vectors and he can be measured by C itself. The channel vectors g^ and 
gB in the reverse links can be measured and sent by A and B, respectively, via a feedback channel to 
Cq If channel reciprocity holds (for example in time-division duplex systems), we have g^ = and 
gs = rig, and thus no CSI feedback is needed for nodes A and B. Note that the channels Had and Hbd 
are not needed at C, and C only needs the secondary receiver D to report whether it correctly decodes 
the PUs' signals in the first phase or not. This message is also local with respect to the secondary receiver 
D and the secondary node C. Thus we claim that in our considered cognitive two-way relay network, 
the optimization at C only needs local information and is applicable in practical systems. 

III. Linear Transceiver Designs 

In this section, linear transceiver designs at the secondary node C associated with different relay 
strategies are considered. Our objective is to maximize the achievable rate of the SU while maintaining 
the rate requirements of the two PUs. Note that the power splitting is embedded in the transceiver design 
automatically and will not be discussed separately in this section. 

A. Joint Design of W and Q s Under AF Two-Way Relay Strategy 

Based on (01), ([5]), the achievable rates of the PUs and the SU are denoted, respectively, as 

^ F = \ log 2 (l + SINR^), i = A,B, 

f (13) 
7^ = \ log 2 (l + SINR^). 

2 Here we assume that the PUs are cooperative and feed back gA and gs correctly. This assumption is widely used in the 
literatures QH, Q5), Q7). 
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Here the factor 1/2 results from the fact that two phases are required for the cooperative transmission. 
The SINRs in (fT3l) are given, respectively, by 

Rlir^Wti-l 2 

SINR^ = ■ 2M TWII2 1 = A > B 



gfQ,g:+4iigfwiii+ar 



and 



SINR^ F = g ^3 sgh 



y " " a A PA\g T D Wh A \ 2 + a B P B \g T D Wh B \ 2 + a 2 c \\g T D W\\ 2 + a 2 



D 



where aj, for i G {A, B}, is a binary indictor with aj = indicating that the secondary receiver .D 
correctly decodes the signal from the PU i and the corresponding interference is then subtracted from 
the received signal in (01) and otherwise <n = 1. The optimization problem is thus yielded as 

SINR^ F (14) 
s.t. SINR^ > TV, i = AB 



max 
W,Q s bO 



P4||Wh A ||2 + P B \\Wh B \\ 2 2 + Tr(Q s ) + 4| | W||| < P c 

where Tj = 2 2Rl — 1, for i G {^4,1?}, with i?j denoting the rate requirement of the PU i. To proceed to 
solve (fl~4l ). we have the following lemma. 

Lemma 1: The optimal Q s in (fl~4l ) can be rank-one and denoted as Q s = qq^, where the optimal q 
has the form as q = Uq. Here q G C Nxl , U = [ui, • • • , u N ] G C MxAr (JV < 3) with {m, • • • , u N } 
being the orthonormal bases which span space G = {g* D ,g A ,g B }. 

Proof: Please refer to Appendix |A) ■ 

Lemma 1 indicates that for the secondary signal s at C, the beamforming is indeed optimal. Moreover, 
the not-yet-determined elements in q are irrelevant to the relay antenna number M and only depend on 
N, i.e., the dimension of space G. Thus, the computational complexity can be reduced in solving (fl"4l) . 
Based on Lemma 1, optimization problem (fT4l ) is simplified as follows 
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max SINRn^ = r^? rn ; n , , ^ -r^ tt (15a) 

w, q a^lggWh^P + aBPelg^WhsP + ^Hg^Wlll + al, 

Fle T Wbl 2 

^ I, 12 , 211 TWII2 , 2 — T *' i> = A,B (15b) 
|t 4 q| 2 +^||g/ W||^ +af 

Tr {W(P A h A h^ + P B h B hf + a 2 c I M )W H } + Tr {qq^} < P c (15c) 

where = g^U, t A = g^U and t B = g#U, inequality (1 1 5cb is obtained by reformulating the power 
constraint in (0. It is not hard to verify that optimization problem ([TBI ) is non-convex. Next, we will find 
the optimal solution of this non-convex problem. 
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We first rewrite the objective function in (1 1 5ab into the form as 

o TNR af = |tpg| 2 

D a A P A \^N\y A \ 2 + a B P B \g T D Wh B \ 2 + 4||g5W||l + al 
Tr(Q iqq H ) 



(16) 



w H Q 02 w + a 2 D 
where w = vec(W), Qoi = t^tu and 

Q02 = (aAPAhAh^ + asPehshf + a 2 c I M ) T ® (gi>g£) • (17) 

Equation (fT6l ) is acquired by using the rule ll22l 

Tr (ABCD) = (?;ec(D T )) T (C T ® A) uec(B), (18) 

then we get Q02 given in (fTTT ). Similar to (fT6l ). we can also transform the SINR constraint (1 1 5bb into the 
form as 

W ^Q1 W > r (19) 

Tr(Q<qq") + w"Q|w + a\ ~ *' V ' 

where Q\ = P|(h^hf ) T ® (g*gf ), QJ, = tf tj and Q| = o£l M ® (g*gf )• Again by using <QJ>, the 
power constraint in (1 1 5cb can be rewritten as 

w fl Qw + Tr{qq H } < P c , (20) 

where Q = (P^h^h^ + Peh^h^ + Oq\m ) T ®Im- Based on (fT6l ). (fT9l ) and (l20l . optimization problem 
( fT5l ) can be recast into the following form by introducing new variables X = qq^ and Y = ww^ 

Tr(QpiX) 

max — - rr (21) 

XbO.YbO Tr(Q 2Y) + a 2 D 

s.t. Tr (Q13Y) - (Q|X) > al i = A, B 
Tr(QY) + Tr{X} < P c 
Rank(X) = 1, Rank(Y) = 1 

where Q* 13 = — Q3. Due to the rank-one constraints, finding the optimal solution of (12Tb is difficult. 
We therefore resort to relaxing it by deleting the rank-one constraints, namely, 

Tr(QoiX) 

max — — ; Tr (22a) 

XhO,YM) Tr(Qo2Y) + a D 

s.t. Tr (Q13Y) - (Q|X) > of, i = A, B (22b) 
Tr(QY) + Tr{X} < P c (22c) 
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Then we shall show that the optimal rank-one solution of (1211) can be obtained from the relaxed problem 
(|22l . According to ll23l . optimization problem ((22"]) is a quasi-convex problem due to the fractional 
structure of the objective function in (|22a| ). In general, optimization problem (1221 can be solved through 
bisection search, which however has high computational complexity. Here we develop an alternative way 
to solve (1221 by using the Charnes-Cooper transformation |[24l . Let 

1 

Z ~ TV(Q 02 Y) + ^- 
By defining X = zX and Y = zY, we can rewrite (|22l as 

max Tr(QoiX) (23) 
s.t. Tr(Q 02 Y) + za 2 D = l 

Tr (Qi 3 Y) - Tr (Q l 2 X) > zaf, i = A,B 
Tr(QY) + Tr{X} < zP c 

After the transformation, it is easy to verify that (l23l is a standard semidefinite programming problem, thus 

its optimal solution can be easily obtained ll25l . Suppose that the optimal solution of ([23l is {X*, Y*, z*}, 

the optimal solution of (1221 . denoted by {X*,Y*}, can always be obtained through X* = ^ and 

Y* = It is worth noting that if X* and Y* are rank-one, then the optimal solution of ((211 can be 

obtained by using eigenvalue decomposition. Otherwise, the optimal rank-one solution of (l23l can be 

derived from the following theorem. 

Theorem 1: If X* and Y* have higher rank than one, the optimal rank-one solution of (1231 can be 

obtained by using the following procedure. 

• Let rx and ry denote the ranks of X* and Y*, respectively; 
. Repeat 

- Decompose X* as X* = V x Vf with V x £ C Nxrx and Y* as Y* = VyV^ with Vy G C Al2xrY ; 

- Find a nonzero rx x r x Hermitian matrix Mx and a ry x ry Hermitian matrix My to satisfy the following linear 
equations 

Tr(V?Q 02 VyMy) = 

Tr (v?Ql 3 VyMy) - (y x QlVxMx) = 0, i = A,B 

Tr(Vy"QVyMy) + Tr{Vf V x Mx} = 

- Evaluate the eigenvalues Qx,i, Qx,2, • ■ • ,Qx,r x of Mx and set \gx\ = max{|gx,i[, Vi}, and the eigenvalues 
Qy,i,Qy,2, ■ ■ ■ , Qy,r Y of My and set \g Y \ = max{jey :i j, Vi}; 

- Generate new matrices as X' = V x (Ir X ~ (l/gx)Mx) Vf and Y' = Vy (I rr - (l/py)My) Vy , and set 
X* = X' and Y* = Y'; 
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• Until the ranks of X* and Y* are both equal to 1. 

Proof: The proof is based on Theorem 3.2 in |26ll . Since there are four constraints in optimization 
problem (T23T ). by using the above procedure, to satisfy Eq. (24) in |[26l . the ranks of X* and Y* should 



By acquiring the optimal rank-one solution of d23l) . we can further get the optimal solution of (|2TT ) 
and then the optimal solution of ( fT51 ). 

B. Joint Design of Qab and Q s Under DF-XOR Two-Way Relay Strategy 

In this subsection, we consider the case where the secondary node C adopts the DF-XOR two-way 
relay strategy. We assume that C has correctly decoded the received signals from the two PUs in the 
first phase. Otherwise, we claim that the primary transmission is in outage. For this relay strategy, the 
successful and unsuccessful interference subtractions in (O lead to different problem formulations. They 
are thus treated separately in what follows. Note again that for this relay strategy, only both the signals 
sa and are correctly decoded in the first phase at D, the interference term s^sab can be completely 
subtracted from (©. 

Firstly, we assume that the secondary receiver cannot cancel the interference caused by the PUs in (©. 
The corresponding optimization problem is thus given by 



where Qab and Q s are the covariance matrices of sab and s, respectively, as defined in (O, and 
R = maxji?^, Rb}- The constraint (I24bb indicates that the transmission rate of the XORed signal from 
the secondary node C should be larger than the maximizer of {Ra, Rb} such that both primary receivers 
can successfully decode the combined information. As in Lemma 1, we can also prove that the optimal 
Qab and Q s can be rank-one. By defining Qab = ww^ and Q s = qq^, the simplified beamforming 
design problem is yielded as 



be both equal to 1. The proof of Theorem 1 is thus completed. 




(24b) 



(24a) 



Tr (Qab) + Tr (Q a ) < P c 



(24c) 



s.t. 




i = A,B 



(25) 



Hi! + llqlli ^ p c 
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where 7 = 2 2R — 1. To proceed to solve (1231 ). we have the following lemma. 

Lemma 2: The optimal solution of (|25T ) can be obtained in the following two cases: 

• If the dimension of space G defined in Lemma 1, N, is larger than 1, the optimal beamformers in 

d25l ) have the form of w = Uw and q = Uq, where the optimal w and q can be obtained by 

solving the following problem 

|tpq| 2 



max 77 vT< — T ( 26 ) 

w,q tnwr + a i 



ItjWl 2 

s - t - T7 — \2~, — 2 — T) « = A -B 
|tjq| 2 + ct| 

llwlll + llqlll < p c 

where try and tj, for i £ {^4,5}, are defined as in ( fT51 ). Then by transforming d26l ) into an SDP 
problem as in (|23T ). problem (l26l) can be optimally solved as (TT5l) . 
• If = 1, i.e., ui = Spanjgjj, g^, g^}, the optimal q and w can be denoted in the form as 

q = V^Ui, w = V^ui, (27) 
where q and w are two real positive scalars given, respectively, by 

q= > w = r-j ^7^, (28) 

7+1 7+1 

where d = max.{a\/tA, cr^/tB} with tA = |g^ u i| 2 an( l *b = |g|j u i| 2 - 

Proof: Please refer to Appendix |B] ■ 
From Lemma 2, we find that when the channels in BC phase are parallel, the beamforming design can 

be significantly simplified and the closed-form solution can be obtained. 

Secondly, we consider the scenario where the interference has been subtracted from © under the 

condition that both sa and sb have been correctly decoded in the first phase at D. The corresponding 

beamforming design problem can be written as 

max |gjq| 2 (29) 

w,q 

1 T - 12 

s-t. 1 ,2 2 >7, i = A,B 
1 1 w| || + ||q||2 < P C 



Although ( |29l ) has a simpler form than (1251) . we can easily verify that ( [291 is still non-convex. In order 
to optimally solve d29b , we have the following lemma. 

Lemma 3: The optimal solution of (1291 can be obtained in the following three cases: 
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If we have orthonormal bases {m, 112} and {ui, • • • , u^v} which satisfy Spanjui, 112} = Spanjg^, g^}, 
and Spanjui, • • • , vln} = Spanjg^,, g^, g^} with N > 2, the optimal w and q can be written in 
the form as 

N 

w = waS A + w B e~ je g* B , q = ^ qiin, (30) 



1=1 

where wa and wb are two real positive scalars, 6 = Zg^g* B and g/,V7 are N complex scalars. By 
defining w = [wa,wb] t and q = [gi, • • ■ ,<?iv] T , the optimal w and q can be obtained by solving 
the following second-order cone programming problem 

max Sft(tcq) (31) 

w,q 

s.t. |tjq| 2 + of < -(aiw) 2 , i = A, B 

7 

l|Gw||l + ||q||l < P c 

where G = [g* A ,e~ je g* B ], t D and tj, for i =G {A, B], are defined as in ([15]), &a = [Hg^Hl) ISaSbI] 
and a B = [|g£g^|,| |g B | ||]. 

• If ui = Span{g^, g^} and Spanjui, U2} = Span{g^, g^, g^}, the optimal w and q can be written 
in the form as 

w = \/wui, q = Uq, (32) 

where w is a real positive scalar, U = [ui, U2] and q E C 2 . The optimal q and w are given by 

q= V p c -7dB~2 V , w = 7 (i + 7|bq| 2 , (33) 

where d = Tnax.{a 2 A /\gA\ 2 , °~b/\9b\ 2 } with qa and gs being defined as g^ = </aui and g^ = 
gB^i, b = ujfj, v is the eigenvector of B i AB 2 related to the maximum eigenvalue, and with 
A = U^g^g^U and B = 7 b H b + I 2 . 

• If ui = Span{g^, g^, g^}, the optimal w and q are given as in d2Tb . 

Proof: Please refer to Appendix O ■ 
From Lemma 3, we find that in general, when the interference is canceled at the secondary receiver D, 
the beamforming design can be simplified by recasting it into an SOCP problem, which can be solved 
more efficiently than the previous SDP problem. Similar to Lemma 2, when the channels {g^,g^} or 
{gj,,g^,g|j} are parallel, the closed-form solution can be obtained. 
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C. Joint Design of Q^, Qb and Q s Under DF-SUP Two-Way Relay Strategy 

In this subsection, we consider that the DF-SUP relay strategy is adopted at the secondary node C. 
In what follows, we also assume that C has perfectly recovered the information transmitted from the 
two PUs. Otherwise we claim that the primary transmission is in outage. Similar to the DF-XOR case, 
different formulations have been presented for with and without interference cancelation at the secondary 
receiver D. 

Firstly, we consider the scenario where none of the interference terms has been subtracted from the 
received signal ud,2 in (fT2l) . Based on (fTOb . (fTTT) and (fT2l) . the optimization problem is formulated as 



max, log 2 (l+ "fjTP^ — 2 ) 04a) 



gfQsg* + o\ 



s.t. - log 2 ( 1 + T t! , ; 2 )>R h i = A,B (34b) 



Tt(Qa) + Tv(Q B ) + Tr(Q s ) < P c (34c) 

where Qa and Qb are the covariance matrices of sa and sb, respectively, as defined in (fTD~b . Note that 
in constraint (I34bb . the rate thresholds for sa and s b are different since the messages to the two primary 
receivers are encoded separately. Similar to the DF-XOR relay strategy, the optimal Q^, for i € {A, B, s}, 
in (l34l can be rank-one. Thus, by letting = w^w^f, Qb = w^w^ and Q s = q<q H , problem (l34l) 
is simplified as 

_ max _ - — 7p~z — tz. F^r - — To <T (35) 

I T - i2 

s.t. - „ _ =■ > Tj , % = A, B 

|g/q| 2 + ^ 

1 1 wa| ll + ||w B || + ||q||| < P c 

where T{ = 2 2Rl — 1, for i G {A, B}, as defined in (fT4l . The optimal solution of (l35l ) is summarized in 
the following lemma. 

Lemma 4: With Spanjui, • • • , Ujv} = Span{g£>, g^, g^} and U = [u%, ■ ■ ■ , uat] as in Lemma 1, the 
optimal solution of (I35T ) can be obtained in the following two cases: 

• When N > 2, the optimal solution of (|35T ) can be written in the form as 



Wa = Uwa, w B = Uw B , q = Uq, (36) 

where the optimal w^, w# and q can be obtained as in (031 ) by transforming (l35l ) into an SDP 
problem as (1231 . 
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When N = 1, i.e., ui = Spanjg^, g^, g^}, the optimal solution of (I35T ) can be denoted in the 
form as 

q = y/qux, w A = y/wjui, w B = y/w B ~u 1 . (37) 
The optimal coefficients in (1371 ) are given, respectively, by 

IV A = QTB H 7 5 = QT~a H 7 j (38) 



Ta + Tb + 1 ' t B ' ' t A 

where ti = |g^ui| 2 , for i G {^4, B}, as defined in (1281) . 

Proof: Please refer to Appendix |D] ■ 
Secondly, we consider the scenario where one of the interference terms has been subtracted from 
(fT2l ). Without loss of generality, we assume that the signal is canceled before demodulation, the 
corresponding beamforming design problem is formulated as 

_ max _ „ 7T (39) 

WA,w B ,q + 

Itr^w~l 2 

S - L | r ,n o >r f , i = A,B 
\gi q| 2 + of 

NwaIII + HwbIII + llqlll < p c 

Since d39l has a similar form with (I35T ). the proposed method in Lemma 4 can also be applied to solve 
(l39l . Namely, when N > 2, problem (l39l should be solved by transforming it into an SDP problem. 
While if JV = 1, the closed-form solution of d39l is derived as in (l37l ). which implies that when N = 1, 
the optimal beamformers are irrelevant to the left interference term. 

Finally, we consider the scenario where the two interference terms are completely subtracted from 
(fT2~l ). which leads to the following optimization problem 

_max_ |gnq| 2 (40) 

w A ,w B ,q 

I T - i2 
IS w il 

S.t. - T _ ;r > Tj, Z = A, B 

let ql 2 + *i 

1 1 wa| |1 + ||ws||2 + ||q||| < Pc 

The optimal solution of (l40l is summarized in the following lemma. 

Lemma 5: The optimal solution of (l40l can be obtained in the following two cases: 
• When N > 2, the optimal solution of (l40l can be written in the form as 

q = Uq, w A = y/wAg* B , wb = V^bSA' ( 41 ) 



17 



where U is defined as in Lemma 1. The optimal coefficients in (|4TT ) are given, respectively, by 

q=7^Hv, w A = ™ q H tft B q+-^|, = t A q + (42) 

V HgBll! \\SB\\2 \\SA\\2 \\SA\\2 

where Pc = Pc — Trnf? ~~ it^ht^ v i s tne eigenvector of D'jCD"! related to the maximum 

1 1 S-A 1 1 a I ISs 1 1 2 

eigenvalue, and with C = t^to and D = n^n| t^t^ + \\^1 \\ i ^b^b + I at- 
• When 7Y = 1, i.e., ui = Span{g^, g^, g^}, the optimal solution of (f40b can be written in the form 

as 

q = v^ui, w A = T/wA~g B , w B = VwBg% (43) 
The optimal coefficients in (l43l) are given, respectively, by 

2 2 

T ^ ff A t bQ'b i T i9 9 i T i9 9 

g = Z i g r„ 12 ~ i^t,, 12 ) = — n TTI i — Ti iTT> W B = — n M4 h Ti iT4 - (44) 

IIBa|| 2 ligslb 

Proof: Please refer to Appendix El ■ 

IV. Simulation results 

In this section, some examples are presented to evaluate the proposed transceiver designs. We assume 
that the fading in each link follows independent Rayleigh distribution and the channel gain on each link 
is modeled by the distance path loss model, given as aij = c ■ d~™, where c is an attenuation constant 
set as 1, n is the path loss exponent and fixed at 3, and djj denotes the distance between nodes i and j. 
Without loss of generality, we suppose that (Ia,b = 1- The node D is placed in the perpendicular bisector 
of link A — > B and the vertical distance from D to the link A — > B is 0.5. Thus we have 

dc,u = ^(%^-^, c ) 2 + 0.5 2 . 

For simplicity, the noise powers at all the destination nodes are set to be the same, i.e., a\ = a B = 
a C = °D = c 2 = 1 and the transmit powers at the two PUs are set as Pa = Pb = P = 5 dB. During 
the first phase, the secondary receiver D applies the simple successive interference cancelation (SIC) 
decoding where the stronger signal is always decoded first, followed by the weaker signal. We let the 
rate requirements of the two PUs be Ra = olR and Rb = (1 — a)R, where the target sum-rate R is 

i Pd 2 

given by R = KRq with Rq = ^ log 2 (l H — -4^) and K being any constant. Throughout the simulation, 
the performance is evaluated in two-folds. The first one is the maximum achievable rate of the SU given 
that the rate requirements of both PUs are satisfied. The other one is the outage probability that the rate 
requirements of the two PUs cannot be fulfilled. 
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In Fig. |2] and Fig. |3l we illustrate the average achievable rate of the SU and the outage performance 
of the primary transmission in subfigures (a) and (b), respectively, as the function of the power Pc 
by choosing d^c = ds,c = 0-5 and M = 4. Specifically, the rate requirements of the two PUs are 
symmetric, i.e., a = 0.5, in Fig. [2] and asymmetric with a = 0.1 in Fig. [3] For comparison, two different 
primary rate requirements with K = 1 and K = 3 are simulated for each scenario. From Fig. |2j we 
find that when the target sum-rate of the PUs is small (R = Ro), the three considered two-way relay 
strategies perform closely from both the primary and secondary user's perspectives. However, when the 
target primary sum-rate is high (R = 3Rq), the DF-XOR relay strategy performs the best, and the DF- 
SUP relay strategy outperforms the AF relay strategy. This indicates that under the symmetric scenario, 
the secondary node C would prefer to re-generate the primary signals when it wants to maximize the 
secondary transmission rate since the destination noise at the secondary node C is not accumulated 
for the subsequent transmission. Moreover, combining the information using XOR is better than using 
superposition since the power of the secondary node C can be used more efficiently in the DF-XOR 
relay strategy. However, under the asymmetric condition, we observe from Fig. [3] that the DF-SUP relay 
strategy performs better than two other strategies, and the AF relay strategy begins to outperform the 
DF-XOR strategy when K = 1. This is because when Ra 7^ Rb, the bemaforming design for DF-XOR 
in (1241) should make the achievable primary transmission rate larger than the maximizer of Ra and Rb, 
which degrades the system performance. While for the DF-SUP strategy, since different primary messages 
are encoded individually, the power can be allocated to two primary messages more flexibly, which saves 
the power and improves the performance of the SU. For the outage performance of the PU, we find 
that when the rate requirements of the PUs are small, i.e., K = 1, the outage approaches zero for all 
the strategies. As the rate requirements increase, i.e., K = 3, the outage of the primary transmission 
is increased significantly. In general, the AF relay strategy has a higher outage probability due to the 
accumulation of the back-propagated noise. In addition, the DF-SUP relay strategy has higher outage than 
the DF-XOR relay strategy under the symmetric primary rate requirements. While for the asymmetric 
case, the opposite result can be observed. 

In Fig. |U the power ratio shared by the SU, i.e., Tr p^ , is illustrated as the function of the secondary 
node power Pc with target sum-rate R = 3i?o at dA,c = ds,c = 0.5 and M = 4. We find that with 
symmetric primary rate requirements, the SU can share more power with the DF relay strategy than with 
the AF relay strategy. Moreover, the DF-XOR relay strategy needs less power to meet the primary rate 
requirements than the DF-SUP strategy. The observation is consistent with the comparison result given 
in Fig. |2(a)| While in the asymmetric scenario, as we explain earlier, the DF-XOR relay strategy needs 
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more power than the DF-SUP relay strategy to satisfy the asymmetric primary rate requirements, which 
results in the performance degradation for the SU. It is noted that in asymmetric scenario, although the 
DF-XOR relay strategy can offer more power to the SU than the AF relay strategy as shown in Fig. 01 the 
DF-XOR relay strategy still achieves close performance with the AF relay strategy as shown in Fig. |3(a) 



The main reason is that with the DF-XOR relay strategy, the secondary receiver needs to correctly decode 
both primary signals simultaneously in the first phase to cancel the interference, which becomes difficult 
in the asymmetric primary transmission. 



Fig. |5(a)| and Fig. |5(b)| illustrate the average achievable rate of the SU for symmetric primary rate 
requirements and asymmetric primary rate requirements, respectively, by changing distance cIa,c- The 
similar observations can be made as in Fig. [2] and Fig. [3] Namely, under the symmetric primary rate 
requirements, the DF-XOR relay strategy performs the best, followed by the DF-SUP relay strategy and 
the AF relay strategy. While under the asymmetric primary rate requirements, the DF-SUP relay strategy 
turns to perform the best, and the AF relay strategy outperforms the DF-XOR relay strategy. From the 
plots, we find that all the strategies achieve the best performance at d,A,c = 0.5 for both symmetric and 
asymmetric conditions. This implies that placing the secondary node C in the middle of A and B is 
always the best choice. 

Finally, in Fig. [6] and Fig. |7J the average achievable rate of the SU and the outage performance of the 
primary transmission are shown in subfigures (a) and (b), respectively, as the function of antenna number 
M by setting d,A,c = ds,c = 0.5 and Pc = 5 dB. For the symmetric primary rate requirements in Fig. |6l 
the similar comparison results can be observed as in Fig. |2] Moreover, we find that as M increases, the 
performance gap between three strategies becomes small and the outage for all the strategies approaches 
zero quickly. While for the asymmetric case in Fig. |7J we find that when K = 1, the DF-SUP relay 
strategy almost attains the same performance with the AF relay strategy when M becomes large and they 
outperform the DF-XOR relay strategy. However, with larger primary rate requirements of K = 3, we 
find that the DF-SUP relay strategy begins to significantly outperform the other two relay strategies, and 
the performance of the AF relay strategy is close to the DF-XOR relay strategy. While for the outage 
performance of the primary transmission with the asymmetric rate requirements, the same result can be 



observed as in Fig. 3(b) 



V. Conclusions 

In this paper, we studied transceiver designs for a cognitive two-way relay network with the aim of 
maximizing the achievable transmission rate of the SU while maintaining the rate requirements of the 
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PUs. Three different relay strategies were considered and the corresponding transceiver designs were 
formulated. By using suitable optimization tools, the optimal solutions were found for all the cases. Our 
simulation results showed that when the rate requirements of the two PUs are symmetric, the DF-XOR 
relay strategy performs the best and the least relay power is required to meet the rate requirements of 
the PUs. While the primary rate requirements are asymmetric, the DF-SUP performs the best along with 
the least relay power consumption to satisfy the rate requirement of the PUs. 

Appendix A 
Proof of lemma 1 

We assume that the optimal solution of W in (fT4l is denoted as W, then the optimal Q s can be solved 
from the following optimization problem 

max goQsgh (45) 
s.t. gf Q s g* < Oi, i = A,B 
Tr(Q s ) < P c 

where 0% = EM^hl _ ^| |^w| \* _ a f and p c = p c _ { p A \ | wh A | |§ +P B ||Wh B || 2 2 + ^||W|| 2 F ). 



By using the circle property of trace operator, we can rewrite (1451) as 

max Tr(C Q s ) (46) 
s.t. Tr(CiQ s ) < o i: i = A,B 
Tr(Q s ) < P c 

where Co = g^gj and Cj = g*gf ■ Then for (146*1 ). we can use the same method as in the proof of 



Theorem 3.2 in 11261 to prove that the optimal Q s can be rank-one although (1461 ) has a different objective 
function from 1251 . To proceed, we first write the Lagrangian function of d46l ) as C = Tr(CoQ s ) — 
A!(Tr(C A Q s ) - o A ) ~ A 2 (Tr(C B Q s ) - o B ) - A 3 (TY(Q S ) - P c ) where \ > 0, for i G {1,2,3}, are 
three Lagrangian multipliers. The corresponding Lagrangian dual function is yielded as g{\\, X2, A3) = 
sup Qs ^o Tr{(C - AiCa - A 2 Cb - A 3 Ia/)Q s } + \\oa + ^203 + hPc- The dual problem of d46j) is 
thus written as 

min Xioa + A 2 os + A 3 Pc 

Ai>0,A 2 >0,A 3 >0 

s.t. C - XiC A - X 2 C B - A 3 Ia/ < 
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Other than satisfying the constraints in (1461) . the optimal solution of (I46t should also satisfy the following 
complementary slackness conditions 

Ai (Tr(C A Q s ) - o A ) = 0, 
A 2 (Tr(C B Q s ) - o B ) = 0, 

(47) 

A 3 (Tr(Q s ) - P C ) = 0, 

Tr ((C - AiC A - X 2 C B - X 3 I M )Q S ) = 0. 
Since the number of the constraints in (l46l ) is three, we can always apply the similar procedure provided 
in Algorithm 1 in [26] to obtain a feasible rank-one solution to satisfy the conditions given in (l47"T ). The 
brief proof is given as follows: suppose that the rank of the obtained Q s in d46l ) is r and it can be 
decomposed as Q s = ~VV H with V 6 C Mxr . Then a Hermitian matrix M is introduced to satisfy 

Tr (V^CiVM) = 0, Tr (V H VM) =0, i = A, B. (48) 

If r 2 > 3, we can always find a nonzero solution M satisfying ( |48l . By defining Si, for i G {1, 2, . . . , r}, 
as the eigenvalues of M and letting | <5"o | = max{|<5j|, Vi}, we then get = V (Ir — (1/5q)M.) V h . It 
is easy to see that the rank of Q s is reduced by at least one compared with Q s . In the meantime, we 
can check that is also a feasible solution of d46l and satisfies the optimal conditions in d47T ), which 
further indicates that Q^, is also an optimal solution of d46l) but with less rank than Q s . Repeat the above 
procedure until r 2 < 3, an optimal rank-one solution of (l46l ) is finally obtained. 

Next we prove that the optimal beamformer regarding to s should lie in space G defined in Lemma 
1. Note that the similar conclusion has been obtained for interference channel in |27l . We next give our 
proof with some differences. By setting Q s = qq^, problem (fT4l) becomes 

jg-j^qp 

W 3 ! a A P A \glWh A \i + a B P B \glWh B \2 + ^Hg^WH 2 + o\ ^ 



^IgfWh^ ' 2 
,grq| 2 + 4llgfW||I + a? 

Tr {W(P A h A h^ + P B h B \4 + a 2 c I M )W H } + Tr {qq^} < P c (49c) 

It is assumed that space C M is spanned by orthonormal bases {ui,--- ,uat,vi,-- - ,vm-n} with 
Spanjui,-- - ,ujv} = Span{g^, g^, g^}. Without loss of generality, we assume that the optimal q 
is given by q = YliLi a i u i + S^fa^ wnere ®-i an d Pi are complex scalars. It is easy to verify that 
the term /3jv; does not affect the value of g^q, g^q and g^q. If there is a non-zero scalar fii which 
makes q contain the vector Vj, extra power of P = (3f will be required. By denoting T = [g^,g^], we 



s -t- i T-,o on t „9 , 9 > i = A,B (49b) 
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define U g = T(T i/ T)~ 1 T' f/ as the orthogonal projection onto space {g^,g^} and Ilj- = I — II g as 
the orthogonal projection onto the orthogonal complement of space {g^,g^}. It is easy to verify that 
{H g g* D , Hggp, g* A , g* B } spans the same space with {g^g^g^}. If we give the consumed extra power 
P to the term n^-g^ in q, we can always increase the value of the objective function while not affecting 
the constraints in (|49l ). This contradicts the optimality assumption made before. Thus we complete the 
proof of Lemma 1. 

Appendix B 
Proof of lemma 2 

When N > 2, similar to Lemma 1, it is easy to verify that optimization problem (|25T ) can be simplified 
as (l26l ). Although (l26l ) is a non-convex problem, by transforming it into an SDP problem, optimal solution 
can be obtained as in d23l ). Next we derive the optimal solution at N = 1. Since ui = Spanjg^, g^, g^}, 
according to Lemma 1, the optimal w and q can be written in the form as 

q = gui, w = ?Dui, 

where q and w are two complex scalars. It is observed that multiplying q or w with an arbitrary phase 
shift does not affect the value of the objective function and the constraints in ( T25T ). Thus, without loss 
of generality, the optimal w and q can be written in the form as in (|27T ). By substituting (l27l ) into d25l) . 
problem (|25T ) transforms into 

max tt- (50) 

q,w wt£> + a D 

wti 
qti + erf 
q + w < Pc 

where to = Igjuij 2 and £j, for i € {A, B}, is defined as in (|28T ). By defining d = max.{a^/tA, <^b/^b}, 
problem (l50l) is equivalent to the following problem 

max — — — 7T- (51a) 

q,vi wt£> + a D 

s.t. > 7 (51b) 

q + a 

q + w<P c (51c) 



It is easy to observe that the optimal q and w in (1511 ) must consume all the power to make constraint 
d51c| ) active. Otherwise, the left power can always be assigned to q and w to further increase the value of 
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the objective function, which contradicts the assumption of optimality. Besides that, we can also see that 
the optimal solution should make constraint (15 lbb active. Otherwise, we can always lower it; to make the 
constraint (15 lbb active and increase the value of the objective function. We thus acquire the following 
two equations 

w 

— — =7, q + w = Pc- 
q + d 

Then we obtain the optimal solution in d28l ). The proof of Lemma 2 is thus completed. 



Appendix C 
Proof of lemma 3 

It is observed that (f29l > have a similar form as (fT5T ). Thus, when N > 2, problem (|29l ) can be solved 
by transforming it into an SDP problem similar to (l23l and then using Theorem 1 to obtain the optimal 
solution. Next we provide an alternative way to solve (|29l ) by transforming it into an SOCP problem 
which can be solved more efficiently than the SDP problem. To conduct this transformation, we need 
to first prove the structure of the optimal beamformer given in d30b - For the optimal structure of q, the 
proof is similar to Lemma 1. We next only focus on deriving the structure of optimal w. Note that the 
similar form of beamformer has also been proven for the pure two-way relay channel in [28 ], we next 
show that it is also suitable to our considered case. Since Span{ui,U2} = Span{g^,g^}, we can write 
the optimal w in the form as w = waS*a + ^bS*b w ith ^a and wb being two complex scalars. Since 
any phase shift of w does not affect its optimality, the optimal w can be further denoted as 

w = W A g*A + wb^Eb, 

where wa and wb are two real positive scalars. We assume that the optimal w consumes the power of 
P w from P c , i.e., 1 1 w| || = itf^HgAlll + ^sllsslll + ^wawb\SaSb\ cos (^ + ^) = P W with # being 
defined in QUI ). Then as in |[28l , the received signal power at the two primary receivers can be rewritten 

as 

|g>| 2 = |^||g A ||2 + ^|g^|e^)| 2 

/ \e T e* I 2 

II |2 I n 2/|| ||2 &yl&_B 

= II&a|| 2 Pw - wb(.\\Sb\\ 2 ~ I, n 2 . 
V IISAII2 

and |g^w| 2 = Hgslli (Pw — ^(lls^lli — ^gf^l ^ e °b serve tn at if <f> ^ — 9 at the optimal solution, 
we can always decrease the value of wa and wb to increase |g^w| 2 and |g|Jw| 2 while keeping the 
consumed power P\y constant. In this way, we can always extract some power from w and give it to q 
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to increase the value of the objective function while keeping the constraints satisfied, which contradicts 
the assumption of optimality made before. We thus obtain (l30l ). Based on (l30l) . we have 

|g5w| 2 = (waWeaWI + wb\EaS*b\) 2 = (saw) 2 , 

(52) 

|gi?w| 2 = (w A e~ 3e \gBg* A \ + w B e' 3d \\g B \\l) = (a B w) 2 , 



where a^ and a# are defined as in (131b . It is easy to see that both a^w and a^w in (1521 are positive 
scalars. Moreover, using the structure of q in (f30b . we have 



|g5q| 2 = l^ql 2 , |gfq| 2 = |t,q| 2 , i = A,B. (53) 

Note that in (l53l . for any optimal q, we can always find a phase-shifted version e J,3 q to make the scalar 
tjjq real and positive while making |tjq| 2 , for i G {^4, B}, constant. Thus, without loss of generality, we 
can maximize 3J(tr;q) instead of |t£iq| 2 to get the optimal solution of (|29l ), which leads to optimization 
problem (I3TT ). It is easy to verify that (f3TT > is a standard SOCP problem which can be efficiently solved 

E3. 

When ui = Span{g^, g^} and {ui, 112} = {g* D ,g* A , g* B }, similar to Lemma 2, we can prove that the 
optimal w and q in d29l ) have the form as in (l32l . By assuming = g A u\ and g^ = gs^-i, problem 
d29b turns into 

max |aq| 2 (54) 

ui,q 

S ' t - I |2IU^I2 I 2 — 7> » = A, 5 

|c/i| 2 |bq| 2 +ct 2 
||q||2+^<-P<7 

where a = g^U with U being defined in d32l and b is defined in d3"3l ). Problem d54l ) is equivalent to 
the problem with the following form 

max |aq| 2 (55a) 

Ib^pTrf 2 ' <55b) 

||q||3+to <P C (55c) 

where d is defined in d33l . It is seen that the optimal solution of (1551 must make constraint (155bl ) active, 
otherwise we can always extract some power from w to make (155bl ) active and give it to q to further 
increase the value of the objective function. The active constraint (155bl ) leads to w = 7ci + 7|bq| 2 , which 
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further simplifies (1551 ) as 



max |aq| 2 (56) 
q 

s.t. ||q|| 2 + 7 |bq| 2 <P C -ld 



Problem (l56l) can be rewritten as 



max q^Aq (57) 
q 

s.t. q^Bq <P C ~ld 

where A and B are defined in (|33T ). By transforming (l57l ) into the following form 

max q B 2AB jq 
q 

s -t- llqlll = Pc-jd 

we thus obtain the solution given in d33l ). 

When ui = Spanjg^, g^, g^}, the optimal solution can be obtained as in Lemma 2. We then complete 
the proof of Lemma 3. 

Appendix D 
Proof of lemma 4 

As in Lemma 1, the optimal q, and in d35l ) should have the form as in (|36l ). Then d35l ) can 
be simplified as 

|tgq| 2 

max - : - tt (58) 

w A ,w B ,q \t D WA\ Z + \tDWB\ + a D 

II w a||| + II w bII2 + llqlll < p c 

Similar to (031) . problem d58l ) can be solved by transforming it into an SDP problem as (|23T ) and then 
the optimal solution is obtained by using Theorem 1. 

When N = 1, similar to Lemma 2, we obtain that the optimal solution should have the form given in 
(l37l) . Substituting them into (I35T ). we have 

max 7T- (59a) 

S.t. q + WA + WB < Pc (59b) 
tlWj > Ti , i = A,B (59c) 



*i5 + of 
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where to is defined in (l50b and ij is denned in (|38T ). In d59l ), we can verify that constraint (|59cb must be 
active, otherwise we can always extract some power from w-i, for i G {A, 5}, to make constraint (I59cb 
active and increase the value of the objective function. Hence we obtain the following two equations 



tAWB tBWA 

2" = TA ' " ; — - = t b, 



t A q + o A t B q + o% 

which further lead to 

wa = qTB + — — , wb = qTA + — — • (60) 

t B t A 

Since at the optimal solution, constraint d59b| ) should also be active. By substituting d60l into (|59b| ), we 
obtain the optimal solution given in (|38T ). 

Appendix E 
Proof of lemma 5 

Since in (l40l . the beamformer is only related to the channel gj, we therefore obtain that the optimal 
Wj should have the form given in (|4TT ). Substituting them into d40l , we have 

max q^t^t^q (61a) 

q,w A ,w B 

|tjq| 2 + af 

waWzbWI + wbWzaWI + \H\l < Pc (61c) 
Again using the fact that constraint (16 lbb should be active, we obtain 

2 

^llSilll = TTli2 t l Ht ? t i < l + 1T^2' i = A ' S - (62) 
\\%i\\2 llgilla 

Since the power constraint (16 lcb should be active at the optimal solution, by combining with (f62b . we 
have 

max q^Cq 
q 

s.t. q H Dq = Pc 

where Pc, C, D are defined as in (l42l) . Similar to the proof of Lemma 3, we finally obtain the optimal 
solution given in (l42l) . 
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When N = 1, similar to (|4TT) . the optimal beamformers should have the form given in (l43l) . Then we 
can simplify problem (|40T > by substituting them into (l40l ). which yields 



s.t. 



max g (63) 

q,w A ,w B 

g|gi Ui| 2 + 
^AllgfiHi + ^sHgA^ + 9 < PC 

Similar to the proof of (l42l ). we can derive the optimal coefficients given in (144b by using the fact that 
the optimal solution in (l63l should make all the constraints active. 
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Fig. 1. Illustration of a cognitive two-way relay network. 
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Fig. 2. Performance comparison for different relay strategies at M — 4 with a = 0.5 when changing Pc- 
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Performance comparison for different relay strategies at M — 4 with a = 0.1 when changing Pc- 
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Fig. 6. Performance comparison for different relay strategies at a — 0.5 when changing M. 
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Fig. 7. Performance comparison for different relay strategies at a — 0.1 when changing M. 



